-
Notifications
You must be signed in to change notification settings - Fork 92
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[ENH] add caching action for elephant-data #633
Open
Moritz-Alexander-Kern
wants to merge
87
commits into
NeuralEnsemble:master
Choose a base branch
from
INM-6:enh/add_caching_action
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
[ENH] add caching action for elephant-data #633
Moritz-Alexander-Kern
wants to merge
87
commits into
NeuralEnsemble:master
from
INM-6:enh/add_caching_action
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Moritz-Alexander-Kern
changed the title
[ENH] add caching acion for elephant-data
[ENH] add caching action for elephant-data
Apr 19, 2024
remove neo version cap
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR adds a GitHub Actions runner for caching data from the Gin Elephant data repository and enabling local data usage for validation tests with the
elephant.datasets
module.This reduces the time required for data retrieval from gin, overall reducing the runtime of the GitHub Actions runners.
GitHub Actions Runner: Added a new GitHub Actions runner to cache data from the Gin Elephant data repository. Caching action is configured to execute as a cron job on a daily basis. This automated process ensures that data caches remains up-to-date.
Local Data Usage for Validation Tests: The
elephant.datasets
module has been modified to use local data for validation tests. Additionally validation tests across various modules have been adapted to accommodate the option of using either local data or retrieving data from the Gin Elephant repository.The path to local data can be provided by setting the environment variable
ELEPHANT_DATA_LOCATION
.Changes to CI
Current CI runners have been adapted to retrieve the cached elephant-data.